Librarian-Led Assessment of Medical Students' Evidence-Based Medicine Competency: Facilitators and Barriers.

Introduction: We must ensure, through rigorous assessment that physicians have the evidence-based medicine (EBM) skills to identify and apply the best available information to their clinical work. However, there is limited guidance on how to assess EBM competency. With a better understanding of their current role in EBM education, Health Sciences Librarians (HSLs), as experts, should be able to contribute to the assessment of medical student EBM competence. The purpose of this study is to explore the HSLs perspective on EBM assessment practices, both current state and potential future activities. Methods: We conducted focus groups with librarians from across the United States to explore their perceptions of assessing EBM competence in medical students. Participants had been trained to be raters of EBM competence as part of a novel Objective Structured Clinical Examination (OSCE). This OSCE was just the starting point and the discussion covered topics of current EBM assessment and possibility for expanded responsibilities at their own institutions. We used a reflexive thematic analysis approach to construct themes from our conversations. Results: We constructed eight themes in four broad categories that influence the success of librarians being able to engage in effective assessment of EBM: administrative, curricular, medical student, and librarian. Conclusion: Our results inform medical school leadership by pointing out the modifiable factors that enable librarians to be more engaged in conducting effective assessment. They highlight the need for novel tools, like EBM OSCEs, that can address multiple barriers and create opportunities for deeper integration of librarians into assessment processes.

Exploring the use of metacognitive monitoring cues following a diagram completion intervention.

Studying texts constitutes a significant part of student learning in health professions education. Key to learning from text is the ability to effectively monitor one's own cognitive performance and take appropriate regulatory steps for improvement. Inferential cues generated during a learning experience typically guide this monitoring process. It has been shown that interventions to assist learners in using comprehension cues improve their monitoring accuracy. One such intervention is having learners to complete a diagram. Little is known, however, about how learners use cues to shape their monitoring judgments. In addition, previous research has not examined the difference in cue use between categories of learners, such as good and poor monitors. This study explored the types and patterns of cues used by participants after being subjected to a diagram completion task prior to their prediction of performance (PoP). Participants' thought processes were studied by means of a think-aloud method during diagram completion and the subsequent PoP. Results suggest that relying on comprehension-specific cues may lead to a better PoP. Poor monitors relied on multiple cue types and failed to use available cues appropriately. They gave more incorrect responses and made commission errors in the diagram, which likely led to their overconfidence. Good monitors, on the other hand, utilized cues that are predictive of learning from the diagram completion task and seemed to have relied on comprehension cues for their PoP. However, they tended to be cautious in their judgement, which probably made them underestimate themselves. These observations contribute to the current understanding of the use and effectiveness of diagram completion as a cue-prompt intervention and provide direction for future research in enhancing monitoring accuracy.

Twelve tips for applying the think-aloud method to capture cognitive processes.

The think-aloud method is an established technique for studying human thought (cognitive) processes. Problem-solving and decision-making are essential skills for medical professionals, and the cognitive processes underlying these skills are complex. Studying these thought processes would enable educators, clinicians, and researchers to modify or refine their approaches and interventions. The think-aloud method has been utilized for capturing cognitive processes in a variety of fields, including computer usability, sports and cognitive psychology. Medical education also recognizes thought processes as valuable data for research and education. This article aims to guide researchers and educators through the preparation and implementation of a think-aloud method to record participants' thought processes during an activity.

Basic psychological needs satisfaction as a mediator between clinical learning climate, self-regulated learning and perceived learning in the nursing education context.

PURPOSE: Self-regulated learning (SRL) can enhance students' learning process. Students need support to effectively regulate their learning. However, the effect of learning climate on SRL behavior, its ultimate effect on learning and the underlying mechanisms have not yet been established. We explored these relationships using self-determination theory. MATERIALS AND METHODS: Nursing students (N = 244) filled in questionnaires about SRL behavior, perceived learning, perceived pedagogical atmosphere and Basic Psychological Needs (BPN) satisfaction after their clinical placement. Structural equation modelling was used to test a model in which perceived pedagogical atmosphere affects SRL behavior and subsequent perceived learning through BPN satisfaction. RESULTS: The tested model had an adequate fit (RMSEA = 0.080, SRMR = 0.051; CFI = 0.972; TLI = 0.950). A positively perceived pedagogical atmosphere contributed to SRL behavior, which was fully explained by BPN satisfaction. SRL partially mediated the contribution of pedagogical atmosphere/BPN to perceived learning. CONCLUSIONS: A learning climate that satisfies students' BPN contributes to their SRL behavior. SRL behavior plays a positive but modest role in the relationship between climate and perceived learning. Without a culture that is supportive of learning, implementation of tools to apply SRL behavior may not be effective. Study limitations include reliance on self-report scales and the inclusion of a single discipline.

Understanding effort regulation: Comparing 'Pomodoro' breaks and self-regulated breaks.

BACKGROUND: During self-study, students need to monitor and regulate mental effort to replete working memory resources and optimize learning results. Taking breaks during self-study could be an effective effort regulation strategy. However, little is known about how breaktaking relates to self-regulated learning. AIMS: We investigated the effects of taking systematic or self-regulated breaks on mental effort, task experiences and task completion in real-life study sessions for 1 day. SAMPLE: Eighty-seven bachelor's and master's students from a Dutch University. METHODS: Students participated in an online intervention during their self-study. In the self-regulated-break condition (n = 35), students self-decided when to take a break; in the systematic break conditions, students took either a 6-min break after every 24-min study block (systematic-long or 'Pomodoro technique', n = 25) or a 3-min break after every 12-min study block (systematic-short, n = 27). RESULTS: Students had longer study sessions and breaks when self-regulating. This was associated with higher levels of fatigue and distractedness, and lower levels of concentration and motivation compared to those in the systematic conditions. We found no difference between groups in invested mental effort or task completion. CONCLUSIONS: Taking pre-determined, systematic breaks during a study session had mood benefits and appeared to have efficiency benefits (i.e., similar task completion in shorter time) over taking self-regulated breaks. Measuring how mental effort dynamically fluctuates over time and how effort spent on the learning task differs from effort spent on regulating break-taking requires further research.

Dealing with Desirable Difficulties: Supporting Students to Accept, Reduce, or Silence Effort.

In this writing, I summarize the insights from my keynote lecture at the annual 2023 IAMSE Meeting in Cancún, Mexico, titled "Effort is the new smart. Supporting students in the self-regulated use of desirable difficulties." I explain how self-regulated learning is challenging for many students in higher education and even more so under learning conditions that create desirable difficulties: conditions that foster long-term learning and transfer of knowledge and skills, but that are generally more effortful to engage in. I describe how the intricate relation between perceived effort and perceived learning determines students' use of desirable difficulties. Finally, I outline promising interventional approaches academic teachers can employ to support students to seek out and engage in desirable difficulties.

Holistic processing only? The role of the right fusiform face area in radiological expertise.

Radiologists can visually detect abnormalities on radiographs within 2s, a process that resembles holistic visual processing of faces. Interestingly, there is empirical evidence using functional magnetic resonance imaging (fMRI) for the involvement of the right fusiform face area (FFA) in visual-expertise tasks such as radiological image interpretation. The speed by which stimuli (e.g., faces, abnormalities) are recognized is an important characteristic of holistic processing. However, evidence for the involvement of the right FFA in holistic processing in radiology comes mostly from short or artificial tasks in which the quick, 'holistic' mode of diagnostic processing is not contrasted with the slower 'search-to-find' mode. In our fMRI study, we hypothesized that the right FFA responds selectively to the 'holistic' mode of diagnostic processing and less so to the 'search-to-find' mode. Eleven laypeople and 17 radiologists in training diagnosed 66 radiographs in 2s each (holistic mode) and subsequently checked their diagnosis in an extended (10-s) period (search-to-find mode). During data analysis, we first identified individual regions of interest (ROIs) for the right FFA using a localizer task. Then we employed ROI-based ANOVAs and obtained tentative support for the hypothesis that the right FFA shows more activation for radiologists in training versus laypeople, in particular in the holistic mode (i.e., during 2s trials), and less so in the search-to-find mode (i.e., during 10-s trials). No significant correlation was found between diagnostic performance (diagnostic accuracy) and brain-activation level within the right FFA for both, short-presentation and long-presentation diagnostic trials. Our results provide tentative evidence from a diagnostic-reasoning task that the FFA supports the holistic processing of visual stimuli in participants' expertise domain.

Supported Independence: The Role of Supervision to Help Trainees Manage Uncertainty.

PURPOSE: Safe and effective supervised practice requires a negotiated partnership between trainees and their supervisors. Substantial work has explored how supervisors make judgments about trainees' readiness to safely engage in critical professional activities, yet less is known about how trainees leverage the support of supervisors when they perceive themselves to be at the limits of their abilities. The purpose of this study is to explore how trainees use supervisory support to navigate experiences of clinical uncertainty. METHOD: Using a constructivist grounded theory approach, the authors explored how novice emergency medicine trainees conceptualized the role of their supervisors during experiences of clinical uncertainty. They employed a critical incident technique to elicit stories from participants immediately following clinical shifts between July and September 2020, and asked participants to describe their experiences of uncertainty within the context of supervised practice. Using constant comparison, 2 investigators coded line-by-line and organized these stories into focused codes. The relationships between these codes were discussed by the research team, and this enabled them to theorize about the relationships between the emergent themes. RESULTS: Participants reported a strong desire for supported independence, where predictable and accessible supervisory structures enabled them to work semiautonomously through challenging clinical situations. They described a process of borrowing their supervisors' comfort during moments of uncertainty and mechanisms to strategically broadcast their evolving understanding of a situation to implicitly invoke (the right level of) support from their supervisors. They also highlighted challenges they faced when they felt insufficiently supported. CONCLUSIONS: By borrowing comfort from-or deliberately projecting their thinking to-supervisors, trainees aimed to strike the appropriate balance between independence for the purposes of learning and support to ensure safety. Understanding these strategic efforts could help educators to better support trainees in their growth toward self-regulation.

Skeptical self-regulation: Resident experiences of uncertainty about uncertainty.

OBJECTIVES: Managing uncertainty is central to expert practice, yet how novice trainees navigate these moments is likely different than what has been described by experienced clinicians. Exploring trainees' experiences with uncertainty could therefore help explicate the unique cues that they attend to, how they appraise their comfort in these moments and how they enact responses within the affordances of their training environment. METHODS: Informed by constructivist grounded theory, we explored how novice emergency medicine trainees experienced and managed clinical uncertainty in practice. We used a critical incident technique to prompt participants to reflect on experiences with uncertainty immediately following a clinical shift, exploring the cues they attended to and the approaches they used to navigate these moments. Two investigators coded line-by-line using constant comparison, organising the data into focused codes. The research team discussed the relationships between these codes and developed a set of themes that supported our efforts to theorise about the phenomenon. RESULTS: We enrolled 13 trainees in their first two years of postgraduate training across two institutions. They expressed uncertainty about the root causes of the patient problems they were facing and the potential management steps to take, but also expressed a pervasive sense of uncertainty about their own abilities and their appraisals of the situation. This, in turn, led to challenges with selecting, interpreting and using the cues in their environment effectively. Participants invoked several approaches to combat this sense of uncertainty about themselves, rehearsing steps before a clinical encounter, checking their interpretations with others and implicitly calibrating their appraisals to those of more experienced team members. CONCLUSIONS: Trainees' struggles with the legitimacy of their interpretations impact their experiences with uncertainty. Recognising these ongoing struggles may enable supervisors and other team members to provide more effective scaffolding, validation and calibration of clinical judgments and patient management.

Warning bells: How clinicians leverage their discomfort to manage moments of uncertainty.

OBJECTIVES: It remains unclear how medical educators can more effectively bridge the gap between trainees' intolerance of uncertainty and the tolerance that experienced physicians demonstrate in practice. Exploring how experienced clinicians experience, appraise and respond to discomfort arising from uncertainty could provide new insights regarding the kinds of behaviours we are trying to help trainees achieve. METHODS: We used a constructivist grounded theory approach to explore how emergency medicine faculty experienced, managed and responded to discomfort in settings of uncertainty. Using a critical incident technique, we asked participants to describe case-based experiences of uncertainty immediately following a clinical shift. We used probing questions to explore cognitive, emotional and somatic manifestations of discomfort, how participants had appraised and responded to these cues, and how they had used available resources to act in these moments of uncertainty. Two investigators coded the data line by line using constant comparative analysis and organised transcripts into focused codes. The entire research team discussed relationships between codes and categories, and developed a conceptual framework that reflected the possible relationships between themes. RESULTS: Participants identified varying levels of discomfort in their case descriptions. They described multiple cues alerting them to problems that were evolving in unexpected ways or problems with aspects of management that were beyond their abilities. Discomfort served as a trigger for participants to monitor a situation with greater attention and to proceed more intentionally. It also served as a prompt for participants to think deliberately about the types of human and material resources they might call upon strategically to manage these uncertain situations. CONCLUSIONS: Discomfort served as a dynamic means to manage and respond to uncertainty. To be 'tolerant' of uncertainty thus requires clinicians to embrace discomfort as a powerful tool with which to grapple with the complex problems pervasive in clinical practice.

Undergraduate Radiology Education During the COVID-19 Pandemic: A Review of Teaching and Learning Strategies [Formula: see text].

The Coronavirus disease 2019 (COVID-19) pandemic has altered how medical education is delivered, worldwide. Didactic sessions have transitioned to electronic/online platforms and clinical teaching opportunities are limited. These changes will affect how radiology is taught to medical students at both the pre-clerkship (ie, year 1 and 2) and clinical (ie, year 3 and 4) levels. In the pre-clerkship learning environment, medical students are typically exposed to radiology through didactic lectures, integrated anatomy laboratories, case-based learning, and ultrasound clinical skills sessions. In the clinical learning environment, medical students primarily shadow radiologists and radiology residents and attend radiology resident teaching sessions. These formats of radiology education, which have been the tenets of the specialty, pose significant challenges during the pandemic. This article reviews how undergraduate radiology education is affected by COVID-19 and explores solutions for teaching and learning based on e-learning and blended learning theory.

Thinking fast or slow? Functional magnetic resonance imaging reveals stronger connectivity when experienced neurologists diagnose ambiguous cases.

For ∼40 years, thinking about reasoning has been dominated by dual-process theories. This model, consisting of two distinct types of human reasoning, one fast and effortless and the other slow and deliberate, has also been applied to medical diagnosis. Medical experts are trained to diagnose patients based on their symptoms. When symptoms are prototypical for a certain diagnosis, practitioners may rely on fast, recognition-based reasoning. However, if they are confronted with ambiguous clinical information slower, analytical reasoning is required. To examine the neural underpinnings of these two hypothesized forms of reasoning, 16 highly experienced clinical neurologists were asked to diagnose two types of medical cases, straightforward and ambiguous cases, while functional magnetic resonance imaging was being recorded. Compared with reading control sentences, diagnosing cases resulted in increased activation in brain areas typically found to be active during reasoning such as the caudate nucleus and frontal and parietal cortical regions. In addition, we found vast increased activity in the cerebellum. Regarding the activation differences between the two types of reasoning, no pronounced differences were observed in terms of regional activation. Notable differences were observed, though, in functional connectivity: cases containing ambiguous information showed stronger connectivity between specific regions in the frontal, parietal and temporal cortex in addition to the cerebellum. Based on these results, we propose that the higher demands in terms of controlled cognitive processing during analytical medical reasoning may be subserved by stronger communication between key regions for detecting and resolving uncertainty.

"I Was Worried About the Patient, but I Wasn't Feeling Worried": How Physicians Judge Their Comfort in Settings of Uncertainty.

PURPOSE: Clinical educators often raise concerns that learners are not comfortable with uncertainty in clinical work, yet existing literature provides little insight into practicing clinicians' experiences of comfort when navigating the complex, ill-defined problems pervasive in practice. Exploring clinicians' comfort as they identify and manage uncertainty in practice could help us better support learners through their discomfort. METHOD: Between December 2018 and April 2019, the authors employed a constructivist grounded theory approach to explore experiences of uncertainty in emergency medicine faculty. The authors used a critical incident technique to elicit narratives about decision making immediately following participants' clinical shifts, exploring how they experienced uncertainty and made real-time judgments regarding their comfort to manage a given problem. Two investigators analyzed the transcripts, coding data line-by-line using constant comparative analysis to organize narratives into focused codes. These codes informed the development of conceptual categories that formed a framework for understanding comfort with uncertainty. RESULTS: Participants identified multiple forms of uncertainty, organized around their understanding of the problems they were facing and the potential actions they could take. When discussing their comfort in these situations, they described a fluid, actively negotiated state. This state was informed by their efforts to project forward and imagine how a problem might evolve, with boundary conditions signaling the borders of their expertise. It was also informed by ongoing monitoring activities pertaining to patients, their own metacognitions, and their environment. CONCLUSIONS: The authors' findings offer nuances to current notions of comfort with uncertainty. Uncertainty involved clinical, environmental, and social aspects, and comfort dynamically evolved through iterative cycles of forward planning and monitoring.

Corrigendum: How and Why Do Students Use Learning Strategies? A Mixed Methods Study on Learning Strategies and Desirable Difficulties With Effective Strategy Users.

[This corrects the article DOI: 10.3389/fpsyg.2018.02501.].

Communication skills supervisors' monitoring of history-taking performance: an observational study on how doctors and non-doctors use cues to prepare feedback.

BACKGROUND: Medical students need feedback to improve their patient-interviewing skills because self-monitoring is often inaccurate. Effective feedback should reveal any discrepancies between desired and observed performance (cognitive feedback) and indicate metacognitive cues which are diagnostic of performance (metacognitive feedback). We adapted a cue-utilization model to studying supervisors' cue-usage when preparing feedback and compared doctors' and non-doctors' cue usage. METHOD: Twenty-one supervisors watched a video of a patient interview, choose scenes for feedback, and explained their selection. We applied content analysis to categorize and count cue-use frequency per communication pattern (structuring/facilitating) and scene performance rating (positive/negative) for both doctors and non-doctors. RESULTS: Both groups used cognitive cues more often than metacognitive cues to explain their scene selection. Both groups also used metacognitive cues such as subjective feelings and mentalizing cues, but mainly the doctors mentioned 'missing information' as a cue. Compared to non-doctors, the doctors described more scenes showing negative performance and fewer scenes showing positive narrative-facilitating performance. CONCLUSIONS: Both groups are well able to communicate their observations and provide cognitive feedback on undergraduates' interviewing skills. To improve their feedback, supervisors should be trained to also recognize metacognitive cues, such as subjective feelings and mentalizing cues, and learn how to convert both into metacognitive feedback.

Is there a superior simulator for human anatomy education? How virtual dissection can overcome the anatomic and pedagogic limitations of cadaveric dissection.

Educators must select the best tools to teach anatomy to future physicians and traditionally, cadavers have always been considered the "gold standard" simulator for living anatomy. However, new advances in technology and radiology have created new teaching tools, such as virtual dissection, which provide students with new learning opportunities. Virtual dissection is a novel way of studying human anatomy through patient computed tomography (CT) scans. Through touchscreen technology, students can work together in groups to "virtually dissect" the CT scans to better understand complex anatomic relationships. This article presents the anatomic and pedagogic limitations of cadaveric dissection and explains what virtual dissection is and how this new technology may be used to overcome these limitations.

How and Why Do Students Use Learning Strategies? A Mixed Methods Study on Learning Strategies and Desirable Difficulties With Effective Strategy Users.

In order to ensure long-term retention of information students must move from relying on surface-level approaches that are seemingly effective in the short-term to "building in" so called "desirable difficulties," with the aim of achieving understanding and long-term retention of the subject matter. But how can this level of self-regulation be achieved by students when learning? Traditionally, research on learning strategy use is performed using self-report questionnaires. As this method is accompanied by several drawbacks, we chose a qualitative, in-depth approach to inquire about students' strategies and to investigate how students successfully self-regulate their learning. In order to paint a picture of effective learning strategy use, focus groups were organized in which previously identified, effectively self-regulating students (N = 26) were asked to explain how they approach their learning. Using a constructivist grounded theory methodology, a model was constructed describing how effective strategy users manage their learning. In this model, students are driven by a personal learning goal, adopting a predominantly qualitative, or quantitative approach to learning. While learning, students are continually engaged in active processing and self-monitoring. This process is guided by a constant balancing between adhering to established study habits, while maintaining a sufficient degree of flexibility to adapt to changes in the learning environment, assessment demands, and time limitations. Indeed, students reported using several strategies, some of which are traditionally regarded as "ineffective" (highlighting, rereading etc.). However, they used them in a way that fit their learning situation. Implications are discussed for the incorporation of desirable difficulties in higher education.

Teachers' monitoring of students' text comprehension: can students' keywords and summaries improve teachers' judgment accuracy?

We investigated intra-individual monitoring and regulation in learning from text in sixth-grade students and their teachers. In Experiment 1, students provided judgments of learning (JOLs) for six texts in one of three cue-prompt conditions (after writing delayed keywords or summaries or without a cue prompt) and then selected texts for restudy. Teachers also judged their students' learning for each text, while seeing - if present - the keywords or summaries each student had written for each text, and also selected texts for restudy. Overall, monitoring accuracy was low (.10 for students, -.02 for teachers) and did not differ between cue-prompt conditions. Regulation, indexed by the correlation between JOLs and restudy selections, was significant (-.38 for students, -.60 for teachers), but was also not affected by cue-prompt condition. In Experiment 2, teachers judged students' comprehension of six texts without knowing the students' names, so that only the keywords and summaries, not prior impressions, could inform judgments. Again, monitoring accuracy was generally low (.06), but higher for keywords (.23) than for summaries (-.10). These results suggest that monitoring intra-individual differences in students' learning is challenging for teachers. Analyses of the diagnosticity and utilization of keywords suggest that these may contain insufficient cues for improving teacher judgments at this level of specificity.

Monitoring and regulation of learning in medical education: the need for predictive cues.

CONTEXT: Being able to accurately monitor learning activities is a key element in self-regulated learning in all settings, including medical schools. Yet students' ability to monitor their progress is often limited, leading to inefficient use of study time. Interventions that improve the accuracy of students' monitoring can optimise self-regulated learning, leading to higher achievement. This paper reviews findings from cognitive psychology and explores potential applications in medical education, as well as areas for future research. COGNITIVE PSYCHOLOGY: Effective monitoring depends on students' ability to generate information ('cues') that accurately reflects their knowledge and skills. The ability of these 'cues' to predict achievement is referred to as 'cue diagnosticity'. Interventions that improve the ability of students to elicit predictive cues typically fall into two categories: (i) self-generation of cues and (ii) generation of cues that is delayed after self-study. Providing feedback and support is useful when cues are predictive but may be too complex to be readily used. APPLICATION TO MEDICAL EDUCATION: Limited evidence exists about interventions to improve the accuracy of self-monitoring among medical students or trainees. Developing interventions that foster use of predictive cues can enhance the accuracy of self-monitoring, thereby improving self-study and clinical reasoning. First, insight should be gained into the characteristics of predictive cues used by medical students and trainees. Next, predictive cue prompts should be designed and tested to improve monitoring and regulation of learning. Finally, the use of predictive cues should be explored in relation to teaching and learning clinical reasoning. CONCLUSIONS: Improving self-regulated learning is important to help medical students and trainees efficiently acquire knowledge and skills necessary for clinical practice. Interventions that help students generate and use predictive cues hold the promise of improved self-regulated learning and achievement. This framework is applicable to learning in several areas, including the development of clinical reasoning.